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Abstract 


In 1984, Abaffy, Broyden, and Spediacto (ABS) introduced a class of the 
so-called ABS algorithms to solve systems of real linear equations. Later, 
the scaled ABS algorithm, the extended ABS algorithm, the block ABS 
algorithm, and the integer ABS algorithm were introduced leading to var- 
ious well-known matrix factorizations. Here, we present a generalization 
of ABS algorithms containing all matrix factorizations such as triangular, 
WZ, and ZW. We present the octant interlocking factorization and show 
that the generalized ABS algorithm is more general to produce the octant 
interlocking factorization. 


AMS subject classifications (2020): 15A03; 15A21; 15A23; 34C20; 49M27. 
Keywords: ABS algorithms; Quadrant interlocking factorization; Octant 


interlocking factorization. 


1 Introduction 


The basic ABS class of algorithms was first introduced by Abaffy, Broyden, 
and Spedicato [1] for solving linear systems of equations. Let R and R™*” 
denote the set of real numbers and the set of m xn real matrices, respectively. 
Consider the system of linear equations 
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Ax = b, xceR”", ACR", BER”, m<n, (1) 


where rank(A) is arbitrary. With A = [a1,...,@m]7, the system is equiva- 
lently written as 
afxg=b;, i=1,...,m. (2) 


An ABS algorithm generates a sequence of approximations x; such that 2441 
is a particular solution of the first 7 equations and leads to the general solution 
of a linear system by computing a particular solution and a matrix with rows 
producing the null space of the coefficient matrix. 

An ABS method starts with an arbitrary initial vector 7; € R” anda 
nonsingular matrix H, € R"*". Given x; , a solution of the first i — 1 
equations, and H; a matrix with rows generating the null space of the first 
i — 1 rows of the coefficient matrix, an ABS algorithm computes 2,41 as a 
solution of the first 7 equations and H;+1, with rows generating the null space 
of the first 7 rows of the coefficient matrix. Below, we give the class of basic 
ABS algorithms for solving systems of linear equations (13). 


Algorithm 1 (Basic ABS algorithm). 

(1) Give 2; € R”*”, arbitrary, H, € R"*”, arbitrary and nonsingular. Set 
t=landr=0. 

(2) Compute 7; = af x; — bj and s; = Hyaj. 

(3) If (s; = 0 and 7; = 0), then let 234, = 7;,Hj,, = H; and go to (6) 
(the ith row of A is dependent on its first i — 1 rows). If s; = 0 and 7; 4 0, 
then stop (the ith equation and hence the system is incompatible). 

(4) Compute the search vector p; by 


pe He fs (3) 


where f; € R” is an arbitrary vector satisfying a? H} f; 4 0. Compute 


and 
Tj41 = L— AY. 


(5) (Update the null space generator) Update H; by 


(4) 


where q € R” is an arbitrary vector satisfying s?q; 4 0, and let r=r+1. 
(6) If i = m, then Stop (H7,,, generates the null space of A and r is its 
rank) else let i =7+ 1 and go to (2). 


Here, we recall some properties of ABS algorithms; for more details, see 
[3]. For simplicity, we assume that A € R™%*” has full row rank. 
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1. The system may be incompatible, which can be detected in step (3), when 
s; =Oand 7; =); — al x; £0. 

2. H;a; # 0 if and only if a; is linearly independent of a,,...,aj—1. 

3. If a1,...,a; are linearly independent, then the search vectors p,...,D; 
are linearly independent. 

4. If a1,...,a; are linearly independent, then with P; = (p1,...,p;), the im- 
plicit factorization AP; = L; holds, where L; is nonsingular lower triangular. 
Different choices of the parameters Hj, f;, and q; lead to different matrix 
factorizations. 


Theorem 1 (LX factorization). Let A € R"*” be a nonsingular matrix 
and let H,; = J. Then, there exits an index set ky < ko <-:: < kn such 
that , Hits # 0, for k = 1,...,n, and the parameter choices f; = qi = €x, 
are well-defined. Let [n] = {1,...,n}, By = {ki,..., ki}, and N; = [n]\B;. 
Then, we have the following properties: 

(1) Every kth row of Hj41 with k € B; is a null row. 

(2) The vector p; has n — i zero components; its k;th component is equal to 
one. 

(3) For each k € Nj, the kth column of H;+, is the unit vector e,, while for 
each k € B;, the kth column of H;+, has zero components in the jth position, 
with j € B;, implying that only i(n — 7) elements need to be computed for 
Aya. 


Proof. See [17]. 


Corollary 1 (LU factorization). Let A € R"*” be a strongly nonsingular 
matrix (that is, the determinants of all the principal submatrices are nonzero) 
and let H, € R”*” be the identity matrix. Then 

(1) the sequence {H;}, where q; = Tia,” 18 well-defined. 

(2) the first i rows of Hi41 are identically zero and the last n — i columns of 
H,41 are equal to the last n — 7 columns of H;. 

(3) P = (pi,.--,pn) is an upper triangular matrix. 


Proof. See [3, Theorems 6.3 and 6.5]. 


The scaled ABS method produces a matrix factorization V' AP = L, 
where L is a lower triangular matrix. Choices of the parameters Hy, fi, 
and q; determine particular methods within the class so that various matrix 
factorizations are derived; see [1, 3, 4, 18, 16, 17, 19]. 

Obviously, the original system (13) is equivalent to the following scaled 
system: 

VT Az =V7b, (5) 


where V, the scale matrix, is an arbitrary nonsingular m by m matrix. By 
replacing a; with A’v; in Algorithm 1, a scaled ABS algorithm is obtained. 
Chen and Zhou [5] proposed a generalization of the ABS algorithms, named 
as extended ABS (EABS) class of algorithms, which differs from the ABS 
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class of algorithms only in updating the Abaffian matrices H;. The block 
ABS algorithm was developed by Abaffy and Galantai [2]. Let n1,...,n, be 
positive integer numbers such that n; +---+n, =n. Consider a block form 
of Aas A= (At,...,A!)?, where A; € R™*”, fori =1,...,s. The Block 
ABS methods may be formulated as follows: 

(1) Compute S; = H;A?. 

(2) Determine F; € R"*" such that F7'S; is nonsingular and set P; = H? F;. 
(3) Update the Abaffian matrix H; by 


His = Hy — H,AT(QTH,AT) ‘QT Hi, (6) 


where Q; € R"*”: is an arbitrary matrix such that $7Q; is nonsingular. Es- 
maeili, Mahdavi-Amiri, and Spedicato [7] presented the integer ABS class of 
algorithms for solving linear Diophantine equations, developed conditions for 
the existence of an integer solution, and determined all integer solutions [6]. 
An extension of the integer ABS algorithm using the scaled ABS algorithms 
was developed by Spedicato et al. [16]. A new class of extended integer ABS 
algorithms for solving linear Diophantine systems by computing an integer 
basis for the null space while controlling the growth of intermediate results 
was developed by Khorramizadeh and Mahdavi-Amiri [13]. Golpar-Raboky 
and Mahdavi-Amiri [10, 11, 12, 14] presented new ideas for updating the 
HT, leading to the development of a new class of extended integer ABS al- 
gorithms. They also showed how to compute the Smith normal form of an 
integer matrix using the scaled integer ABS algorithm [10]. 

For the (not necessarily independent) rows of H;;1 to be a generator of 
null space of the first 7 rows of A, the extended integer ABS algorithms can 
always be tuned to produce an integer basis for the integer null space of the 
coefficient matrix; see Esmaeili, Mahdavi-Amiri, and Spedicato [6]. 


2 Generalized ABS class of algorithms 


The central problem of linear algebra is the solution of linear system of equa- 
tions. Direct methods used to solve linear systems of equations are based on 
factorizations of the coefficient matrix into factors to be easy for use in solv- 
ing the equations. The Gaussian elimination with the corresponding matrix 
decomposition, the LU decomposition, is the most useful method for solv- 
ing linear equations. The method is well-defined if and only if A is strongly 
nonsingular, that is, all principal submatrices, A(1: k,1: k), for all k, are 
nonsingular. The parallel implicit elimination (PIE) method and the WZ 
factorization for solving large systems, suitable for parallel computers, have 
been introduced by Evans [15]. 


Definition 1. Let [n] = {1,...,n} and let a; C [n], for i=1,...,5. We say 
a = {aj,...,as5} is an index set of [n] if and only if a;()a; = 0, whenever 
i Aj, and U#_,a; = [n]. We denote the cardinality of a by jal. 
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Let ja;| = n;, for i = 1,...,s. Then, an index set a = {a4,...,a5} 
is a block permutation vector, when the ith block size is equal to n; and 
n= Dini M- 

Let A € R™*” and let a and £ be two index sets of [n]. Let A(:,}) 
denote the m x |b| submatrix of A containing the columns specified by 6 
and let A(a;,{;), the (i,7)th block of A, denote the |a;| x |;| submatrix 
of A composed of the rows specified by a; and the columns specified by 
B;. Ifa; = B;, then A(a;,8;) is a principal submatrix of A and if a; = 
By = {1,...,k}, 1 < k < min{m,n}, then A(a;,8;) is a leading principal 
submatrix of A. 


Definition 2. Let A € R"*”, let t = {ay,...,as} and 6 = {f1,..., 8s} be 


two index sets of n, and let A(a;,8;), 1 <%,7 < s, denote the (i, 7)th block 
of A. Then, 


A(ay, 81) C +++ C A(US_y ai, US_1;) = A (7) 


is a nested submatrix sequence of A. We say A is (a, )-block strongly 
nonsingular if and only if A(U*_,a;, US_, 8;), for k = 1,...,s, are nonsingular. 


Let P, and Pg denote the permutation matrices moving the rows and 
columns of A based on the index sets a and (, respectively, and let 


Ag,g = PP AP3. (8) 


Corollary 2. Let A € R”*”. Then A is (a, 8)-block strongly nonsingular if 
and only if Aj g is strongly nonsingular. 


Note that Theorem 1 provides a relationship between elimination methods 
and the ABS method. The search vectors p; in step (4) of Algorithm 1 
are aligned sequentially. The generalized elimination method and the ABS 
method do not produce the same matrix factorizations, generally. In the 
next section, we present a generalization of the ABS algorithms containing 
all matrix factorizations produced by the generalized elimination method such 
as triangular, WZ, and ZW. The generalized ABS method is more general to 
produce some new matrix factorizations such as the SO and OS factorizations 
which cannot be produced by the generalized elimination method. 

Let A € R"*”, let a = {ay,...,a 5} and 6 = {61,...,8,} be two index 
sets, and let A; € R!@!*” be such that A; = A(ai,:). 


Algorithm 2 (Generalized ABS algorithm). 

Input: A € R™*”, an arbitrary nonzero vector « € R™*”, an arbitrary 
nonsingular matrix H; € R”*”, and two index sets a = {aj,...,a,5} and 
p= Teiseseh Bale 

For i=1,...,s do 

(1) Compute $; = H;A(ai,:). 

(2) Determine F; € R"*? such that F7'S; is nonsingular and set P(:,a;) = 
HT F,. 

(3) Update the approximation for the solution by 
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x(ai41) = «(ai) — P(:, ai) di, 
where d; is the unique solution of the following nonsingular system: 
A(a;,:)P(:, aj)d; = ri, 


and y= A(ai, 1)4 = Bj. 
(3) Update the Abaffian matrix H; by 


Hi. = Hi — HiA(ai,:)(Q7 HiA(ai, )) QT H,, (9) 


where Q; € R"*® is an arbitrary matrix so that S7Q; is nonsingular. 
end for. 
(4) Let P = (p1,...,Pn) and compute C' = AP. 


Algorithm 2 provides a null space characterization for the matrix A. From 
Algorithm 2, we have Hj1a; = 0, for j € Ul_,ax, where a? is the jth row 
of A. According to (8), Theorem 1 and Corollary 1, we have the following 
results. 


Theorem 2. Let A € R”*”, and let a = (a,...,@5) and B = (1,..., 8s) 
be two index sets. Then, A is (a, @)-block strongly nonsingular if and only 
if I(:,b(4))? H,A(t(i), :)7, for i =1,...,8, are nonsingular. 


Theorem 3. Let Q; = I(:,6;), and let Hj; be defined by (9). Then, the 
following properties hold: 

(a) The jth row of H;+1 is zero, for 7 € UL_,b(k). 

(b) The jth column of H;+1 is equal to the jth column of Hj, for 7 ¢ U,_,b(k). 


Proof. See [3, Theorem 6.3]. 


Now, consider the following definition. 
Definition 3. A € Z”*” is a unimodular matrix if and only if |det(A)| = 1. 
Note that, A is unimodular if and only if A~! is unimodular. 


Remark 1. Let A € Z”*”. If A(ax, 6,), for k = 1,...,8, are unimodular, 
then Algorithm 2 produces an integer matrix factorizatin (B and C are integer 
matrices). 


Algorithm 2 produces a matrix factorization AP = C. Different choices 
of the parameters Q, F, t and 6 lead to different matrix factorizations. For 
a, = 6 =i, Q = Fi; = eG, 1 < i < n, Algorithm 2 produces an LU 
factorization. Next, we show how to choose the parameters in Algorithm 
2 to compute the WZ and ZW factorizations. We also discuss the octant 
interlocking factorization method and present two new factorizations named 
as the OS and SO factorizations. 
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3 Quadrant interlocking factorization 


A direct method, called the WZ factorization, for solving linear systems of 
equations Ax = b was introduced by Evans and Hotzopoulos [9]. Let A be 
an n X n nonsingular matrix. The WZ factorization of [8] expresses A as 
A=W2Z, where W and Z have the following forms: 


ecco6e eoocco5e ecooe 

eecee on et re) 0@e@000 
W=|eceecee!, Z=|]oo00e00], X=]Jooeoo], (10) 

eecee 030000 0e00e0 

ecco6e ecocco5e ecooe 


where the empty bullets stand for zero and the other bullets stand for possible 
nonzeros. 

The matrix W is called a unit W-matrix if in addition, w;; = 1, for 
i =1,...,n, and win-i41 = 0, for i # (n+ 1)/2, when n is odd. The 
transpose of a (unit) W-matriz is called a (unit) Z-matrix and vise versa. 
Moreover, A matrix which is both a Z- and a W-matriz is called an X-matriz. 

Note that, we assume that A is nonsingular and of an even size n (without 
loss of generality) and that s = 4. 
Theorem 4. Let A is an n x n matrix and let n be even. Then A hasa WZ 
factorization if and only if the nested submatrices A(1:k,n—k+1:n,1: 
k,n —k+1:n) are invertible, for k = 1,...,n/2. 


Proof. See proof of of [15, Theorem 2]. 


Now, we show how to choose the parameters of the generalized ABS al- 
gorithm to compute the WZ factorization. 
Consider two index sets a = {a1,...,a,} and 8 = {5 ,,...,8,} such that 
apn = Pe = {k,n -—k+1} and Fy = Qe = [ex, en—n4i], for k = 1,...,5. 
Then, P is a Z-matrix, C is a W-matrix, and Algorithm 2 leads to a WZ 
factorization of A. 


Remark 2. Let A € Z”*”. If the nested submatrices A(1:k,n—k+1: 
n,l:k,n—k+1:n) are unimodular, fork =1,..., 4, then A has an integer 
WZ factorization. 


Consider two equal index sets a = {a1,...,a,} and 8 = {(1,...,85} 
such that a, = 8, = {s —k+1,5+k} and Fy = Qe = [es—r41,€s+x], for 
k =1,...,s. Then, Pisa W-matrix, C is a Z-matrix, and Algorithm 2 leads 
to a WZ factorization of A. 


Theorem 5. Let A € R”*”". Then A has a ZW factorization if and only if 
the nested submatrices A(s —k+1:s+k,s—k+1:6+k) are invertible, 
fork =1,...,s. 
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Remark 3. Let A € Z"*”. If the nested submatrices A(s—k+1:5+k,s— 
k+1:8+k) are unimodular, for k = 1,...,s, then A has an integer ZW 
factorization. 


A Octant interlocking factorization 


Here, we first define octant matrices and then present the Octant Interlock- 
ing Factorization (OIF). We provide the necessary and sufficient conditions 
for the existence of OIF and show how to choose the parameters of the gen- 
eralized ABS algorithm to compute the factorization. 


Definition 4. We say A € R”*” is an octant matrix, if it has one of the 
following structures: 


eooco5e 00800 
eecee 070e0ee0 

S=|ecoce!] ,O=|eececeece|, (11) 
eecee 0@0e0e0 
eooc5e 00800 


with the empty bullets standing for zero and the other bullets standing for 
possible nonzeros. The matrices in (11) are called the S-matrix and the 
O-matrix, respectively. 


Definition 5. Let A € R”*”. We say that A has an octant interlocking 
factorization, if A = BC such that B and C are octant matrices. 


The transpose and the inverse of an S-matrix are an S-matrix and an O- 
matrix, respectively, as well as the transpose and the inverse of an O-matrix 
are an O-matrix and an S-matrix, respectively. 

Note that, we assume that A € R”*” is nonsingular, that n is an even 
number, and that s = 5. 

Consider two index sets a = {a1,...,as} and 8 = {1,...,8;} such that 
an = {k,n —k+1},6, = {s—k+1,54+k}, and Q, = Fe = [ex, Cn—k41]- 


Then, C is an O-matrix and P is an S-matrix. 


Now, let 6, = {k,n —k+ 1}, let a, = {s —k+1,8+4+k}, and let Q; = 
Fy = [€s—n41,@s+x]. Then, P is an O-matrix and C is an S-matrix. 


Theorem 6. Let A €¢ R”*”. Then A has an OS factorization if and only if 
the nested submatrices A(s —k+1:8s+k,1:k,n—k+1:7n) are invertible, 
fork =1,...,s. 


Remark 4. Let A € Z”™*”. If the nested submatrices A(s —k+1:5+k,1: 
k,n—k+1:n), fork =1,...,s, are unimodular, then A has an integer OS 
factorization. 


IJNAO, Vol. 12, No. 2, pp 301-314 


A generalization of the ABS algorithms and its application to some special ... 309 


5 Generalized ABS algorithm and matrix factorizations 


An elimination method is a sequence of elementary row or column operations 
to divide a matrix into parts with partial zeroing of columns or rows of the 
matrix leading to a matrix factorization implicitly. 


Let A € R”*” and let a = {aj,...,as} and 8 = {f1,...,8s} be two in- 
dex sets of n. Algorithm 2 computes a matrix factorization AP = C, with 
parameter choices Q; = F; = I(:,a;) and P(:, 8;) = H} F; as follows: 


A(ay,) Hf =0, i=1,...,k-1, 
and 
Cau, Br) = A(au, :)P(:, Br) = A(ou, :)HgI(:, a4) _ 0, t= 1, Fees k-1. 


This means that in the kth step the generalized ABS algorithm performs a 
partial zeroing such that the elements of the submatrix C' corresponding to 
the columns specified by 6, and the rows specified by a;, fori =1,...,k—1, 
turn to zero. Here, we set the parameters in Algorithm 2 to present the 
associated matrix factorizations C = AP. 


We consider different choices for a and { such that all the blocks A(a;, 3;) 
turn to be 1 x 1 and present the associated matrix factorizations. First, we 
define two index sets. Let J = {j1,...,jn} with the J; as follows: 


jn e if i is odd, (12) 
: n—Z+1  if7 is even. 
We define the index set K = {k1,...,k,} as follows. If n is an even number, 
then define 
a (13) 
De if 7 is even, 
if n is an odd number, then define 
ae oe if 7 is even, 
ki — aan ra ipuea (14) 
om + =a if 71S odd. 


If a; = 6; = 7, then C is a lower triangular and P is an upper triangular 
matrix. For a; = 8; =n—i+1, C is an upper triangular and P is a lower 
triangular matrix. The different cases are noted in Figure 1 


In Figure 2, we give a MATLAB code for Algorithm 2, where A € R”*”, 
t = {ti,...,tn} and b = {bi,...,b,} are two index sets, and all the blocks 
A(a;,0;) are 1 x 1, fori =1,...,n. 
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a, =1,8=k a; = 1, Bj = i; 


a d< 


a, =k, 8:=n-i+l 


Figure 1: Matrix factorizations associated with different index sets 


Function [C,P]=GENABS(A,t ,b) 
cle 
[n,n]J=size (A); 
Beeye(n) ; 
P=zeros(n); 
H=E; 
for i=1l:n 
e-E(: ,[t(i)]); 
q-B(: ,[b(4)]); 
P(:,[b(i) )=H’+q3 
U&e’ x AxH’*q; 
H-H-(HA’* exinv (U’) *q’*H) ; 
end; 
C=AxP; 
end 


Figure 2: MATLAB code for Algorithm 2 
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6 Numerical illustrations 


We give illustrations of our proposed algorithms to compute the Q/F' and 
OIF factorizations. The algorithms were implemented using Matlab R2020a. 


Example 1. Consider the following matrix: 


ll1laq1 1 
PBSC Ae She 6 
Au |13 6 10 15 21 
~ 1141020 35 56 
151535 70 126 
1 6 21 56 126 252 


Let a, = 6 = {s—k+1,s+hk}, fork =1,2,3 and s = } =3. Then, the 
generalized elimination algorithm, Algorithm 1, produces P as a W-matrix 


and C' as a Z-matrix, and we have a ZW factorization as follows: 


-10000 O 
—2 1000 3 
2 -11025 —8 
in -10.301-3 9 
0.2 000 1 —4.8 
0 0000 1 


and 


0.20.3 1 1 0.5 0.2 

00.2 3 4 0.5 0 

C= 0 0 610 0 O 
— 0 0 1020 0 O 

0 0.5 15 35 2.5 0 

0.2 1.8 21 56 10.5 1.2 


Example 2. Let 


13.8966 15.3103 14.1873 2.3800 15.0253 10.9443 

6.3420 15.9040 15.0937 9.9673 5.1019 2.7725 

Ae 19.0044 3.7375 5.5205 19.1949 10.1191 2.9859 
~ | 0.6889 9.7953 13.5941 6.8077 13.9815 5.1502 
8.7749 8.9117 13.1020 11.7054 17.8181 16.8143 

7.6312 12.9263 3.2522 4.4762 19.1858 5.0856 


Let ag = {s—k+1,s+k} and 6, = {k,n—k+1}, fork =1,2,3 and s =3. 
By the generalized ABS algorithm, Algorithm 2, we have 


0 0 1 0 0 0 

0 1.0000 —3.3515 —11.9955 0 0 

poe 1 —0.7279 4.0998 13.5268 —0.8931 0 
~ 10 0.0146 —0.8436 1.3279 —0.2703 1 

0 0 —1.2767 —5.7630 1 0 

0 0 0 1 0 0 
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and 


14.1873 5.0185 —0.4413 —64.2317 1.7108 2.3800 


15.0937 5.0633 0 0 —11.0731 9.9673 

ene 5.5205 0 0 0 0 19.1949 
~ | 13.5941 0 0 0 0 6.8077 
13.1020 —0.4537 0 0 2.9522 11.7054 


3.2522 10.6245 —50.6286 —210.6023 15.0712 4.4762 


We realize that P is an O-matrix, that Cis an S-matrix, and that AP = C. 


7 Concluding remarks 


We presented a generalized elimination approach for solving linear systems. 
We established the necessary and sufficient conditions under which the pro- 
posed method is applicable. We showed that different matrix factorizations 
could be derived from the method such as the LU,WZ, and ZW factoriza- 
tions. We also proposed the octant interlocking factorization to factorize a 
nonsingular matrix into octant matrices. We presented a generalized ABS 
algorithm and showed how to choose the parameters of the algorithm to com- 
pute the WZ and the ZW factorizations as well as the octant interlocking 
factorization of real and integer matrices. 
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